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Non-Equilibrium Steady States 
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Abstract 

The mathematical physics of mechanical systems in thermal equilibrium 
is a well studied, and relatively easy, subject, because the Gibbs distribution is 
in general an adequate guess for the equilibrium state. 

On the other hand, the mathematical physics of non-equilibrium systems, 
such as that of a chain of masses connected with springs to two (infinite) heat 
reservoirs is more difficult, precisely because no such a priori guess exists. 

Recent work has, however, revealed that under quite general conditions, 
such states can not only be shown to exist, but are unique, using the Hormander 
conditions and controllability. Furthermore, interesting properties, such as 
energy ffux, exponentially fast convergence to the unique state, and fluctuations 
of that state have been successfully studied. 

Finally, the ideas used in these studies can be extended to certain stochas- 
tic PDE's using Malliavin calculus to prove regularity of the process. 
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1. The model and results 

I report here on work done, in different combinations, together with Martin 
Hairer, Luc Rey-Bellet, Claude-Alain Pillet, and Lawrence Thomas. In it, we con- 
sidered the seemingly trivial problem of describing the non-equilibrium statistical 
mechanics of a finite-dimensional non-linear Hamiltonian system coupled to two 
infinite heat reservoirs which are at different temperatures. By this I mean that 
the stochastic forces of the two heat reservoirs differ. The difficulties in such a 
problem are related to the absence of an easy a priori estimate for the state of 
the system. We show under certain conditions on the initial data that the system 
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goes to a unique non-equilibrium steady state and we describe rather precisely some 
properties of this steady state. These arc, 

• appearance of an energy flux (from the hot to the cold reservoir) whenever the 
reservoirs are at different temperatures, 

• exponential stability of this state, 

• fluctuations around this state satisfy the Cohen- Gallavotti fluctuation conjec- 
ture. 

I first review the construction of the model. Two features need special atten- 
tion: The modeling of the heat reservoirs and their coupling to the chain, and the 
nature of the coupling among the masses in the chain. I start with the latter: It is a 
1-dimensional chain of n distinct d-dimensional anharmonic oscillators with nearest 
neighbor coupling. The phase space of the c;haiu is therefore R,^''" and its dynamics 
is described by a C°° Hamiltonian function of the form 

n 2 n n— 1 n 2 

Hs{p,<i) = ET+E^r(«.) + E^i'^fe-9m) - Ey + ^(«) ' (1-1) 

where q = {q-^^, . . . , q^), p = (p^, . . . with p^, q- e R*^. We will eventually couple 
the ends of the chain, i.e., q^ and q^, to heat reservoirs. Clearly, for heat conduction 

(2) 

to be possible at all we must require that the are non-zero. But, this is not 
enough and the interaction has to have a minimal strength. A sufficient condition 
for the main result to hold is: For some m2 > rn-^ > 2, and all sufficiently large 
we require 

o<c,< /^(f <4, o<c.< /";y <4, 

and similar growth conditions on the first and second derivatives. Finally, we require 
that each of the {d x d) matrices 

^ i=l,...,n-l, (1.2) 

is non-degenerate (see [12] for the most general conditions). 



Fig. 1: Model of the chain with the two reservoirs at its ends, 

"Hot" at left, "Cold" at right. 

Remark 1.1. It seems that relaxing the condition (1.2) poses hard technical prob- 
lems, although, from a physical point of view, allowing the matrix to be degenerate 
on hyper-surfaces of codimension > 1 should work. See [9,12] for some possibilities. 
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Remark 1.2. If < it seems that the existence of a unique state is jeopar- 
dized by the potential appc'arancc of breathers. Indeed, too much energy can then 
be "stored" in t/^^^ without being sufficiently "transported" between the oscillators. 
A more detailed understanding of this problem would be welcome. 
Remark 1.3. The nature of the steady state in the limit of an infinite chain 
(n oo) is a difficult open question. 

As a model of a heat reservoir we consider the classical field theory associated 
with the d-dimensional wave equation. The field and its conjugate momentum 
field TT are elements of the real Hilbert space H. = H^(R'') © L^(R'') which is the 
completion of C^(R'') © C^(R'') with respect to the norm defined by the scalar 
product: 

((^) , (l))^ = Jdx (|V^(x)p + |7r(x)r) ^ 2H^{^,n) , (1.3) 

where is the Hamiltonian of a bath and the corresponding equation of motion 
is the ordinary wave equation which we write in the form 

Finally, we define the coupling between the chain and the heat reservoirs. The 
reservoirs will be called "L" and "R" , the left one coupling to the coordinate and 
the right one coupling to the other end of the chain (5^). Since we consider two heat 
reservoirs, the phase space of the coupled system, for finite energy configurations, 
is R^''" X H X H and its Hamiltonian will be chosen as 

+ 9i • y da; Qj^{x)Vipj^{x) +qn- j £'r(^)Vv'r(x) . 

(1.4) 

Here, the Qi{x) G L^R"^) are charge densities which we assume for simplicity to be 
spherically symmetric functions. The choice of the Hamiltonian (1.4) is motivated 
by the dipole approximation of classical electrodynamics. We use the shorthand 



We 



set = (^a\^^ a •'^'^ , i G {L, R}, with 



The "hat" means the Fourier transform f{k) = {2Tr)-'^/^ J dx f{x)e-'''-'' . With 
this notation the Hamiltonian is 



H{p, q, 0L> 0r) = Hsip, q) + Hj^{^^) + H^{4>r) + qi ■ (0l> "l)^ + Qn ' (^r> "r)w ' 
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(1.5) 



where H^{(j)) = ^\\(l>\\^- The equations of motions take the form 

Pj(*) = -^,.^(9(0) , i = 2,...,n-l, 

kit) = C{Mt) + aj^-q^{t)) , 
kit) = £(.^R(t)+aR •?„(*)) . 

The last two equations of (1.5) are easily integrated and lead to 

Mt) = e^VL(0)+ fdsLe'-^'-'^a^-q^is) , 
Jo 

Mt) = e^VR(0)+ fdsCe^'^'-^^a^-qJs) , 
Jo 

where the (pi{0), i G {L,R}, are the initial conditions of the heat reservoirs. 

We next assume that the two reservoirs are in thermal equilibrium at in- 
verse temperatures (3-^ and By this 1 mean that the initial conditions $(0) = 
{0l(O), (^j^(O)} are random variables distributed according to a Gaussian measure 
with mean zero and covariance {4'i{f)4'j{g)) = ^iji'^/ Pi)ifT9)n- -'-^ assume that 
the coupling functions af^ arc in Ti for i £ {L. R} and v £ {1, • • • then the 
^j(t) = (/)j(0)(e~'^*a^) are d-dimensional Gaussian random processes with mean zero 
and covariance 

im^M) = kij^iit - ' e {L,R} , (1-6) 

where the dx d matrices {t — s) are 



^''\t-s) = (al-\e^(-^)al^))^ = '-6^^^ J dk\em' cos {\k\{t - s)) . 



Finally, we impose a condition on the random force exerted by the heat reser- 
voirs on the chain. We assume that the covariances of the random processes ^^{t) 
with i G {L, R} satisfy 

ci'"^^(i-^) = V^^e---'*"^'' (1-7) 

with 7i > and > 0, which can be achieved by a suitable choice of the coupling 
functions £ij(a;), for example 

M 



Biik) = const, fj +\?)i/2 ' 

m=l ^ ''■ ^ 
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where all the 7^ are distinct. We continue with the case M = 1 for simpUcity. 

Using (1.7) and enlarging the phase space with auxihary fields r^, one elimi- 
nates the memory terms (both deterministic and random) of the equations of motion 
and rewrites them as a system of Mariovian stochastic differential equations: 



which defines a Markov diffusion process on 

Theorem 1.4. [3,4,12,1] There is a constant X* > 0, such that when \X-^\. |Aj^| € 
(0, A*), the solution of (1.9) is a Markov process which has an absolutely continuous 
invariant measure fi with a C°° density m. This measure is unique, mixing and 
attracts any other measure at an exponential rate. 

Remark 1.5. On can show even a little more. Let /io(/3) be the Gibbs distribution 

for the case where both reservoirs are at temperature 1//?. If /i denotes the density 
of the invariant measure found in Theorem 1.4, we find that h/hg{(3) is in the 
Schwartz space S for all f3 < imn((3i^, P^) . This mathematical statement reflects 
the intuitively obvious fact that the chain can not get hotter than either of the 
reservoirs. 

Remark 1.6. The restriction on the couplings Al, Ap between the small system 
and the reservoirs is a condition of stability (against "explosion" ) of the small system 
coupled to the heat reservoirs: It is not of perturbative nature. Indeed, the reservoirs 
have the effect of rcnormalizing the deterministic potential seen by the small system 
and this potential must be stable. This restricts Al and Aj^. 

The proof of Theorem 1.4 is based on a detailed study of Eq.(1.9). Let 
X = {p,Q,r) and r = {ri^,r^). For a Markov process x{t) with phase space X 
and an invariant measure iJ.{dx), ergodic properties may be deduced from the study 
of the associated semi-group T* on the Hilbert space L^(X, /x(da;)). To prove the 
existence of the invariant measure in Theorem 1.4 one proceeds as follows: Con- 
sider first the semi- group T* on the auxiliary Hilbert space Hq = ^^{X, fiQ^dx)), 
where the reference measure ^^{dx) is a generalized Gibbs state for a suitably cho- 
sen reference temperature. Our main technical result consists in proving that the 
generator L of the semi-group T* on Ti^ and its adjoint have c;ompac;t resolvent. 
This is proved by generalizing Hormander's techniques for hypoelliptic operators of 
"Kolmogorov type" to the problem in unbounded domains described by (1.9). Once 
this is established, we deduce the existence of a solution to the eigenvalue equation 



dp,{t) 
dp jit) 

dPnit) 



Pjit)dt , j^l, 
-V^^V{q{t))dt + r^it)dt , 
-Vgy{q{t))dt , j = 2,. 
-V^^V{q{t))dt + r^{t)dt , 



n — 1 , 



n 



(1.9) 
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{T*)*g = g mTi.Q and this implies immediately the existence of an invariant mea- 
sure. The original proof [3] was subsequently improved by using more probabilistic 
techniques [12]. 

The proof of uniqueness, [4], relies on global controllabihty of (1.9). In it, one 
shows that the control equation, in which the noises of (1.9) are replaced by 
deterministic forces (in the same function space), allows one to reach any given 
point in phase space in any prescribed time, by choosing the forces f^ adequately. 
It is here that, at least at the time of this writing, a feature of the problem seems 
crucial for success: 

Remark 1.7. The geometry of the chain: If the chain is not of linear geometry, 
but with parallel strands, or if the coupling is not of pure nearest neighbor type, 
uniqueness of the invariant measure does in general not follow from the methods 
described here. Very simple counterexamples with harmonic chains [14] show that 

this problem is not easy. 

Remark 1.8. We proved in [3, Lemma 3.7] that the density g = Qj^ is a, real 
analytic function of C = (7l ^ ^r) / (^L +^r)- particular, this yields the standard 
perturbative results near equilibrium (^ = 0). 

Question. A fascinating problem is to imdcrstand the limit of a chain of infinitely 
many oscillators, and in particular the nature of heat conduction in this case. I 
believe that this problem can only be solved if a better understanding of modeling 
the coupling between the heat bath and the chain can be found. 

2. Time-reversal, energy flux, and entropy pro- 
duction 

In the wake of the seminal work of Gallavotti and Cohen [6], several authors 
realized (e.g., [10, 11]) that internal symmetries of stationary non-equilibrium prob- 
lems lead to an interesting relation for the fluctuations in the stationary state. The 
model we consider here is no exception, and it is one of the few examples where the 
Hamiltonian dynamics plays a very nice role. 

It will be useful to streamline the notation.^ The two reservoirs, L and R, are 
described by the variables r = (rL, rj^) e R'' © R''. Let A be the (2d x nd) matrix 
defined by 

q-Ar = q^- A^^r^ + g„ • Aj^rj^ = q^Xj^r^ + q^X^r^ ■ 

Define the (2d x 2d) matrix F = diag 7l ® diag 7j^, let w = ® the 2d- 
dimensional standard Brownian motion, and finally T the (2 x 2) diagonal temper- 
ature matrix T = diag(TL, Tj^). It is useful to introduce the change of variables 
s = Fr — F^q, where F = AF"^/^. In terms of these variables, one can introduce 
the eff'ective potential 

KM = V{q)-^q.AA'^q, (2.1) 
^ This notation generalizes more easily to the case M > 1 of (1.8) . 



Non-Equilibrium Steady States 



415 



and the "energy" is now G{s,q,p) with 

G{s,q,p) = y^ + V^s + ^s-Ts . (2.2) 

Finally, with the adjoint change in the derivatives ^ — FV^, the equations 
of motion (1.9) read 

dq = WpGdt = pdt , 

dp = -(V, - FV,)Gdt = -(V,Kfl.(q) - Frs)dt , (2.3) 
ds = -{V, + F'^Vp)Gdt - {2T^/^)dw = -{Ts + F'^p)dt - {2T^^'^)dw . 

Writing Gp for VpG and for V^G (these are vectors with nd components), and 
Gg for VgG (this is a vector with 2d components), the generator L of the diffusion 
process takes, in the variables y ~ {s, q,p), the form 

L = V,-TV,-G,-V, + (Gp-V,-G,-Vj + ((FGJ-Vp-G^-FV,) . (2.4) 

If / is a function on the phase space X, we let 

S'fiy) ^ (e^V)(j/) = / f{^y{t))dP{w) . 

The adjoint of L in the space L2^j^d(2+2n)^ called the Fokker-Planck operator. 
The density m of the invariant measure is the (unique) normalized solution of the 
equations L^m = 0. 

2.2. The entropy production <7 

Using the notation (2.4), we now establish a relation between the energy flux 
and the entropy production. Since we are dealing with a Hamiltonian setup, the 
energy flux is defined naturally by the time derivative of the mean evolution 5* of 
the effective energy, H^ff{q,p) = p^/2 + V^fi{q). Differentiating, we get from the 
equations of motion d^S*H^ff = S^LH^g , with 

LH^ff = p ■ (-V,Kff + FYs) + V.Kff ■p = p-FTs. 

We define the total flux by $ = p ■ FYs, and inspection of the definition of F and 
r leads to the identification of the flux at the left and right ends of the chain: 
$ = $L + ) with 

Note that $l is the energy flux from the left bath to the chain, and is the energy 
flux from the right bath to the chain. Furthermore, observe that ($)^ = , with 
= /M(dy) f{y) = Jdym{y)f{y) , because $ = LH^g and L^m = 0. 
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Since we have been able to identify the energy fliix on the ends of the chain, 
we can deGne the (thermodynamic) entropy production a by 

a = + ^ = p- FT-^Ts . (2.5) 



2.3. Time-reversal, generalized detailed balance condition 

We next define the "time-reversal" map J by (,//) (.s, q,p) ~ f{s, q, —p). This 
map is the projection onto the space of the ,s, q,p of the time-reversal of the Hamil- 
tonian flow (on the full phase space of chain plus baths) defined by the original 
problem (1.5). 

Notation. To obtain simple formulas for the entropy production a we write the 
(strictly positive) density m of the invariant measure /i as 

m = Je-^e-'f , (2.6) 

where R = R{s) — ■ TT~^s . Let L* denote the adjoint of L in the space 

= L^{X,dfi) associated with the invariant measure fi, where X = R_2(2n+2) 
terms of the adjoint on L^{X, dsdqdp), we have the operator identity 

L* = m-^L^m . (2.7) 

We have the following important symmetry property as suggested by the paper 
[10]. 

Theorem 2.9. Let L^ = L + rja, where 77 e R. One has the operator identity 

Je-''^(L^)*e''^J = . (2.8) 

In particular, 

Je--^'^L*e-^'^J -L = a . (2.9) 

Remark 2.10. This relation may be viewed as a generalization to non-equilibrium 
of the detailed balance condition (at equilibrium, one has JL*J — L = 0). 

The paper of Gallavotti and Cohen [6] describes fluctuations of the entropy 
production. It is based on numerical experiments by [5] which were then abstracted 
to the general context of dynamical systems. In further work, these ideas have been 
successfully applied to thermostatted systems modeling non-equilibrium problems. 
In the papers [10] and [11] these ideas have been further extended to non-equilibrium 
models described by stochastic dynamics. In the context of our model, the setup is 
as follows: One considers the observable W{t) = /J drj a(£,^{r])) . By ergodicity, one 
flnds lim^^j^ t~^W{t) = (cr)^, for all x and almost all realizations of the Brownian 
motion ^^{t) = ^^{t,u)). The rate function e is characterized by the relation 

inf e(y) = — lim - log Prob < -^7-^ G / > . 
yei t^oot ^ \t{a)^ f 
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Under suitable conditions it can be expressed as the Legendre transform of the 
function 

eM = - lim t-ilog(e-'''^(*)) . 

Formally, —e(ri) can be represented as the maximal eigenvalue of L^. Observing 
now the relation (2.8), one sees immediately that 

eiv) = e{l - v) . (2.10) 
Theorem 2.11. [13] The above relations can be rigorously justified and lead to 

e{y)-ei-y) = -y{a)^ . (2.11) 

In particular this means that at equal temperatures, when (cr)^ = 0, the fluctuations 
are symmetric around the mean 0, while at unequal temperatures, the odd part is 
linear in y and proportional to the mean entropy production. Note that when 
(a)^ 7^ this relation describes fluctuations around 0, not around the mean! This 
is the celebrated Gallavotti-Cohen fluctuation theorem. 

3. Extensions 

The technique for proving uniqueness results presented above can be general- 
ized and applied to many other problems, in particular to certain types of "partially 
noisy" PDE's (so that now phase space is infinite dimensional). One kind of ex- 
ample must suffice to illustrate the kind of results one can obtain. Consider the 
stochastic Ginzburg-Landau equation with periodic boundary conditions (written 
in Fourier components, for L » 1): 

dUk = {I- i.k/Lf)uf,dt- ^ u,^^u,^^Uf,^dt + q,^dWf, , fceZ, (2.12) 

ki+k2+k3=k 

with \qf,\ ~ and where tWj. are standard Wiener processes. The point is here 
that q^. may be zero for all |fc| < fc^. 

Theorem 2.12. [2, 8, 7]The process defined by (2.12) has a unique invariant 
measure. Any initial condition is attracted exponentially fast to it. 

Acknowledgments. I thank M. Hairer and L. Rcy-BcUct for help in preparing 
this manuscript. This work was supported by the Fonds National Suisse. 
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